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SUMMARY  PAGE 


THE  PROBLEM 

To  determine  the  equivalence  of  ten  Central  Institute  of  the  Deaf 
(CID)  Sentence  Intelligibility  Lists  and  relate  that  information  to  the 
equivalence  of  corresponding  revisions  by  the  Naval  Submarine  Medi¬ 
cal  Research  Laboratory  (R-CID)  of  the  ten  CID  Lists. 

FINDINGS 

(1)  Two  five-list  combinations  of  the  CID  Lists  yielded  equiva¬ 
lent  scores. 

(2)  Seven  R-CID  Lists  yielded  equivalent  scores . 

(3)  The  mean  scores  for  eight  R-CID  Lists  were  significantly 
lower  than  scores  obtained  with  the  corresponding  CID  Lists. 

(4)  Both  the  CID  and  the  R-CID  sets  of  Lists  contain  a  sufficient 
number  of  equivalent  lists  to  render  them  useful  in  Navy  research 
and  clinical  settings. 

(5)  The  R-CID  lists  have  an  advantage  of  more  equivalent  lists 
and  greater  sensitivity  to  frequency  distortion. 

APPLICATION 

Sentence  Intelligibility  lists  can  be  used  to  provide  oto-audiol- 
ogists  additional  evaluation  of  various  hearing  problems  incurred  by 
Navy  personnel.  Also,  the  lists  can  be  used  by  communications 
engineers  involved  in  determining  figure-of-merit  for  Navy  systems, 
such  as  in  the  case  of  message  sending  from  hyperbaric  or  under¬ 
water  environments  which  create  distortions  in  speech. 
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ABSTRACT 


The  purpose  of  this  study  was  to  investigate  the  equivalency  of 
several  sentence  intelligibility  lists  for  use  in  clinical  hearing  tests 
of  Navy  personnel  and  research  facilities  requiring  figure-of-merit 
indices  of  voice  communication  systems.  Ten  Central  Institute  for 
the  Deaf  (CID)  Sentence  Intelligibility  Lists  and  revisions  of  those 
ten  lists  (R-CID)  were  presented  to  two  groups  of  30  listeners  each. 
Scores  were  the  number  of  correct  key  words  identified  for  each 
sentence  list.  The  following  results  were  obtained:  (1)  Two  five- 
list  combinations  of  the  CID  Sentence  Lists  (A,  D,  E,  G,  J  and  B, 

D,  E,  G,  J)  yielded  equivalent  scores.  (2)  Seven  R-CID  Sentence 
Lists  (A,  C,  E,  F,  G,  I,  J)  yielded  equivalent  scores.  (3)  The 
mean  scores  for  eight  R-CID  Sentence  Lists  (A,  B,  C,  D,  E,  F, 

G,  J)  were  significantly  lower  than  scores  obtained  with  the  corre¬ 
sponding  CID  Lists.  (4)  The  results  suggest  that  both  sets  of  sen¬ 
tence  lists  contain  a  sufficient  number  of  equivalent  lists  to  render 
them  useful  in  most  Navy  research  and  clinical  settings.  The  R-CID 
Lists  have  a  slight  advantage  in  that  they  contain  more  equivalent 
lists  and  appear  to  be  more  sensitive  to  frequency  distortion. 
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EQUIVALENCY  OF  SENTENCE  INTELLIGIBILITY  LISTS  FOR 
AUDIOLOGICAL  ASSESSMENT  OF  NAVAL  PERSONNEL  AND 
NAVY  VOICE  COMMUNICATION  SYSTEMS 


INTRODUCTION 

Sentences  have  re-emerged  as  a  de¬ 
sirable  message  for  the  measurement  of 
speech  intelligibility  (Berger,*  Giolas,4 
Harris,  et  al.  ,7  and  Jerger,  etal/^). 

It  is  argued  that  they  present  a  more 
natural  listening  task  than  do  the  widely 
used  monosyllabic  word  lists  (Hirsh, 
et  al.**)  and  take  advantage  of  crucial 
parameters  utilized  in  understanding 
connected  speech.  Lists  of  Central  In¬ 
stitute  for  the  Deaf  (CID)  Sentences 
(Silverman  and  Hirsh**)  have  been  sug¬ 
gested  as  one  possible  message  for 
clinical  and  research  use.  This  series 
of  sentence  lists  was  developed  to  be 
representative  of  colloquial  speech,  and 
a  close  relationship  was  found  between  . 
scores  obtained  using  selected  lists  of 
the  series  and  a  sample  of  continuous 
discourse  (Giolas4) .  The  sentence  lists 
in  this  selected  set  are  available  in 
written  form  (Davis  and  Silverman  )  and 
are  easy  to  administer  and  score .  In 
addition,  lists  in  that  set  were  revised 
by  Harris,  et  al.7  to  provide  a  greater 
homogeneity  of  sentence  length  while  at¬ 
tempting  to  maintain  the  colloquial 
speech  criterion.  This  revised  set  of 
lists  is  known  as  the  Revised  CID  Sen¬ 
tence  Lists  (R-CID). 

Little  information  is  available  on  the 
equivalency  of  speech  intelligibility 
scores  obtain  with  either  the  CID  or 
R-CID  Sentence  Lists.  Such  list  equiv¬ 
alency  information  is  vital  if  these  lists 
are  to  be  useful  in  the  research  and 
clinical  setting.  Therefore,  the  purpose 


of  this  study  was  to  investigate  the  equiv¬ 
alency  of  speech  intelligibility  scores 
obtained  with  the  two  sets  of  sentence 
intelligibility  lists,  CID  and  R-CID.  In 
addition,  the  effect  of  the  sentence  mod¬ 
ification  procedure  used  to  form  the  set 
of  R-CID  Lists  was  analyzed. 


METHOD 

Filtering  and  Recording 


Each  set  (CID  and  R-CID)  of  sentence 
intelligibility  lists  consists  of  ten  lists, 
each  list  having  50  key  words  embedded 
in  ten  sentences.  All  lists  were  read 
by  an  adult  male*  and  recorded  using  a 
Shure  546  Microphone  and  an  Ampex 
300-2  Tape  Recorder.  Voice  intensity 
was  monitored  with  a  VU-meter  during 
the  recording  sessions. 

To  produce  the  error  responses  nec¬ 
essary  for  comparisons  among  the  test 
lists,  both  sets  of  sentence  intelligibil¬ 
ity  lists  were  distorted  by  420  Hz  low- 
pass  filtering  using  an  Allison  2B  filter 
between  two  Ampex  300-2  tape  record¬ 
ers.  Previous  research  indicates  that 
this  distortion  level  facilitates  compar¬ 
isons  (Duffy  and  Giolas13) .  The  VU  me¬ 
ters  of  the  recorders  were  matched  and 
use  of  a  calibration  tone  ensured  appro¬ 
priate  playback  levels.  Five  practice 
sentences  preceded  each  experimental 
tape  to  familiarize  the  subjects  with  the 
listening  task. 

*The  voice  on  all  these  recordings  was  that  of  the 
second-named  author,  J.  R.  Duffy. 
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Sentence  Presentation 

Sixty  normal-hearing  adult  males 
were  divided  into  two  groups  of  thirty 
each.  One  group  heard  all  ten  CID 
Lists,  the  other  all  tenR-CID  Lists. 
Each  group  was  further  divided  into 
three  sub-groups  of  ten  listeners  who 
heard  a  different  randomization  of  their 
ten  lists.  Test  tapes  were  played  on  an 
Ampex  PR-10  recorder,  via  an  Altec 
1569A  amplifier  to  49  TDH-39  ear¬ 
phones  mounted  in  Otocups.  The  test 
room  was  specifically  designed  for  lis¬ 
tening  experiments.  Each  sub-group 
responded  to  a  monaural  presentation  of 
10  sentence  intelligibility  lists  presented 
at  a  comfortable  loudness  level  and  ad¬ 
ministered  over  two  sessions.  Subjects 
were  asked  to  write  down,  word 
for  word,  what  they  heard  after  each 


sentence  was  presented.  They  were 
encouraged  to  respond  with  complete 
sentences  even  if  this  required  guessing 
at  words  or  phrases  which  they  did  not 
understand.  Scores  were  based  on  the 
number  of  50  key  words  in  each  list  cor¬ 
rectly  identified. 

RESULTS  AND  ANALYSIS 

Data  were  subjected  to  an  analysis  of 
variance  for  a  two  factor  experiment  (A, 
CLD/R-CID;  B,  Lists)  with  repeated 
measures  on  one  factor  (Winer  12>.  The 
results  of  this  initial  analysis  are  sum¬ 
marized  in  Table  1.  The  significant 
"F"  (.01)  obtained  for  the  A  effect  sug¬ 
gests  overall  differences  between  the 
two  sets  of  sentence  lists  for  the  distor¬ 
tion  of  420  Hz  low-pass  filtering.  The 


Table  1.  Summary  of  a  Two  Factor  With  Repeated  Measures 
for  One  Factor  Analysis  of  Variance 
(Winer,  1962,  p.  306) 


Source  of  Variation 

n 

SS 

MS 

F 

Required 

F  (.01) 

Between  S's. 

59 

22919.4183 

A  (CID  &  R-CID  Lists) 

1 

12303,4817 

12303.4817 

67.2199* 

7.10 

Subject  within  groups 

58 

10615.9366 

183.0334 

Within  S's. 

540 

24584.3000 

B  (Lists  A-J) 

9 

2895.7017 

321.7447 

8.8384* 

2.41 

AB 

9 

2686.0349 

298.4484 

8.1984* 

2.41 

Bx  S's  within  groups 

522 

19002.5634 

36.4034 

2 


significant  "F"  (.01)  obtained  for  the  B 
effect  (Lists  A-J)  further  suggests  dif¬ 
ferences  between  some  lists  within  each 
of  the  two  sets.  The  significant  (.01) 
AB  interaction  between  the  two  sets  of 
sentence  lists  and  individual  lists  indi¬ 
cates  additional  analysis  was  appropri¬ 
ate  to  evaluate  separately  lists  within 
each  set. 


Equivalency  of  CID  Sentence  Lists 

Means  and  standard  deviations  of 
scores  obtained  for  the  ten  sentence 


lists  comprising  the  set  of  CID  Sentence 
Lists  are  summarized  in  Table  2.  The 
significant  "F"  (.01)  computed  separ¬ 
ately  for  these  sentence  lists  indicate 
differences  between  mean  scores  for 
lists  comprising  the  CID  set.  The  dif¬ 
ferences  between  the  means  for  all  com¬ 
binations  of  the  ten  sentence  lists  are 
tabulated  in  Table  3,  along  with  an  indi¬ 
cation  of  which  differences  were  found 
to  be  statistically  significant  employing 
a  "critical  difference"  procedure  out¬ 
lined  by  Lindquist?  Mean  scores  ob¬ 
tained  were  not  significantly  (.  01)  dif¬ 
ferent  for  lists  A,  D,  E,  G,  J  or  for 


Table  2.  Summary  of  Mean  Scores  and  Standard  Deviations  Obtained 
with  the  CID  Sentence  Lists  (Scores  based  on  number 
of  50  key-words  correctly  identified) 


Sentence  List 

Mean  Score 

S.d. 

A 

36.93 

7.05 

B 

40.43  j 

7.87 

C 

41.83 

5.21 

D 

37.10 

6.76 

E 

39.73 

6.54 

F 

32.93 

5.63 

G 

40.30 

6.12 

H 

33.67 

6.25 

I 

30.93 

8.96 

J 

38.30 

6,76 
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Table  3.  Differences  Between  Mean  Scores  for  CED  Sentence  Lists 


Lists  A 

B 

C 

D 

E 

F 

G 

H 

I 

J 

3.50* 

4.90* 

.17 

2.80 

4.00* 

3.37 

3.27 

6.00* 

1.37 

B 

1.40 

3.33 

.70 

7.50* 

.13 

6.77* 

9.50* 

2.13 

C 

4.73* 

2.10 

8.90* 

1.53 

8.17* 

10.90* 

3.53* 

D 

2.63 

4.17* 

3.20 

3.44 

6.17* 

1.20 

E 

6.80* 

.57 

6.07* 

8.80* 

1.43 

F 

7.37* 

.73 

2.00 

5.37* 

G 

6. 64* 

9.37* 

2.00 

H 

2.73 

4.64* 

I 

7.37* 

J 

*  Significant  at  .  01  level 


lists  B,  D,  E,  G,  and  J.  The  mean  in¬ 
telligibility  scores  for  the  lists  com¬ 
prising  either  of  these  list  combinations 
did  not  differ  by  more  than  7%.  It  was 
concluded  that  either  five-list  combina¬ 
tion  yields  equivalent  speech  intelligi¬ 
bility  scores  when  presented  under  the 
level  of  distortion  employed  in  this 
study.  A  further  analysis  of  Table  3 
yielded  the  more  detailed  list  equiva¬ 
lency  breakdown  tabulated  in  Table  4. 

In  situations  where  equivalent  lists  are 
necessary,,  care  should  be  taken  to  em¬ 
ploy  only  these  lists  which  yielded  sta¬ 
tistically  similar  scores. 


Equivalency  of  Revised  CID 
Sentehce  Lists 

Means  and  standard  deviations  of 
scores  obtained  with  the  R-CID  set  of 
ten  lists  are  summarized  in  Table  5. 

The  significant  "F”  (.  01)  computed  sep¬ 
arately  for  these  sentence  lists  indi¬ 
cated  differences  among  mean  scores 
for  the  lists  within  this  set.  The  differ¬ 
ences  between  the  means  for  all  com¬ 
binations  of  the  ten  sentence  lists  are 
tabulated  in  Table  6,  along  with  an  indi¬ 
cation  of  which  differences  were  statis¬ 
tically  significant  (.01).  Mean  scores 
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Table  4.  Combination  of  CID  and  Revised  CID  Lists 
Considered  to  Yield  Equivalent  Scores 


C.I.D.  Lists 

Rev.  C.I.D.  Lists 

B=D=E=G=J 

A=C=E=F=G=I=J 

A=D=E=G=J 

B=P=G=I=J 

B=C=E=G 

F=H=I 

H=I 

H=J 

Table  5.  Summary  of  Mean  Scores  and  Standard  Deviations  Obtained 
with  the  Revised  CID  Sentence  Lists 


Sentence  List 

Mean  Score 

S.d. 

A 

30.33 

8.02 

B 

26.63 

8.62 

C 

29.87 

5.65 

D 

21.73 

8.00 

E 

30.00 

5.80 

F 

27.70 

7.32 

G 

27.97 

6.89 

H 

31.47 

5.91 

I 

27.27 

7.46 

J 

28.63 

8.31 
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Table  6 .  Differences  Between  All  Combinations  of  Means  Obtained 
for  Lists  Comprising  the  Revised  CID  Sentence  Lists 


Lists  A 

B 

C 

D  E  F  G  H  I 

B 

3.70* 

.4667 

8.6000*  .3333  2.6333  2.3667  1.1333  3.0667 

1.7000 

B 

3.2333*  4.9000*  3.3667*  1.0667  1.3333  4.8333*  .9333 

2.0 

C 

8.1333*  .1334  2.1666  1.9000  1.6000  2.6000 

1.2333 

D 

8.2667*  5.9667*  6.2333*  9.7333*  5.9327* 

6.9000* 

E 

2.3000  2.0334  1.4666  2.7334 

1.3667 

F 

.2666  3.7666*  .4333 

.9333 

G 

3.5000*  .7000 

.6667 

H 

4.20* 

2.8333 

1.3667 

J 

^Significant  at  the  .  01  level 


obtained  for  lists  A,  C,  E,  F,  G,  I,  and 
J  were  not  found  to  differ  significantly. 
The  mean  intelligibility  scores  for  these 
lists  did  not  vary  by  more  than  8.40%. 

It  was  concluded  that  these  seven  lists 
yield  equivalent  speech  intelligibility 
scores  when  presented  with  the  filtering 
distortion  employed  in  this  study.  Fur¬ 
ther  analysis  of  Table  6  yields  the  more 
detailed  list  equivalency  breakdown 
tabulated  in  the  right  column  of  Table  4. 

It  is  interesting  to  note  that  while 
seven  of  the  ten  lists  comprising  the  R- 


CID  Lists  were  found  to  produce  equiva¬ 
lent  speech  intelligibility  scores,  only 
five  of  ten  original  CID  Lists  were  sta¬ 
tistically  equivalent. 

Effects  of  Sentence  Modification 

The  final  analysis  consisted  of  in¬ 
vestigating  the  effect  of  sentence  modi¬ 
fication.  The  modification  procedure 
involved  both  the  addition  and  elimina¬ 
tion  of  words  from  individual  sentences 
comprising  the  original  lists ,  in  order 
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to  more  closely  equate  them  with  re¬ 
gard  to  sentence  length  (Harris,  et  al7). 
In  many  cases,  the  new  sentence  list 
had  an  altered  meaning  from  its  orig¬ 
inal  counterpart.  However,  attempts 
were  made  to  retain  the  colloquial  na¬ 
ture  of  the  original  lists. 

An  "Fn  was  computed  between  each 
original  list  and  its  corresponding  re¬ 
vised  list  (Winer^2).  As  can  be  seen  in 
Table  7,  eight  of  the  original  ten  sen¬ 
tence  lists  were  significantly  altered  by 


the  sentence  modification  procedure. 

The  mean  scores  were  significantly 
lower  for  all  R-CID  Lists,  except  Lists 
H  and  I.  However,  the  mean  scores  of 
even  these  two  revised  lists  were  lower 
than  were  the  original  two  counterpart 
lists.  The  relationship  between  the  CID 
and  R-CID  Lists  is  graphically  illus¬ 
trated  in  Figure  1.  It  is  apparent  that 
the  revised  lists  (solid  bars)  are  more 
sensitive  to  frequency  distortion  (420 
Hz  low  pass)  than  are  the  original 
CID  lists. 


Table  7.  Summary  of  Means  and  F  Tests  Computed  For  Each  Original 
CID  Sentence  List  and  Its  Corresponding  Revised  List 


List 

C.I.D. 

Rev.  C.I.D. 

F 

A 

36.93 

30.33 

12.80* 

B 

40.43 

26.63 

55.94* 

C 

41.83 

29.86 

42.06* 

D 

37.10 

21.73 

69.36* 

E 

39.73 

30.00 

27.83* 

F 

32.93 

27.70 

8.04* 

G 

40.30 

27.97 

32.09* 

H 

33.66 

31.47 

1.42 

I 

30.93 

27.27 

3.95 

J 

38.30 

28.63 

27.45* 

*  Significant  at  the  .  01  level 
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Fig.  1.  Comparison  of  mean  scores  obtained  for  all  CID  Sentence  Lists  and  their  corresponding  revised 
lists.  Scores  were  based  on  number  of  key  words  correctly  identified. 


CONCLUSIONS 

The  Naval  Submarine  Medical  Re¬ 
search  Laboratory  provides  solutions 
for  the  Navy  to  problems  in  the  area  of 
hearing  encountered  by  the  Naval  Sub¬ 
marine  Force  and  by  Navy  personnel 
working  within  diving/swimming  envi¬ 
ronments.  To  accomplish  this  mission, 
continued  use  is  required  of  various 
indices  of  speech  perception  to  evaluate 
the  capability  to  hear  speech  by  Navy 
personnel  as  well  as  to  determine  the 
figure-of-merit  for  Navy  communica¬ 
tion  systems.  Sentence  intelligibility 
tests  have  certain  advantages  which 
render  them  preferable  to  other  speech 
tests  in  certain  clinical  and  research 
settings.  The  results  of  the  present 
study  indicate  that  both  the  CID  and  the 
R-CID  sentence  intelligibility  tests  con¬ 
tain  enough  equivalent  lists  to  make 


them  valuable  testing  tools.  There  ap¬ 
pear  to  be  advantages  to  using  the  R-CID 
Lists,  since  they  include  more  equiva¬ 
lent  lists  and  are  more  sensitive  to  fre¬ 
quency  distortion.  The  R-CID  Lists 
also  seem  less  predictable  than  the  CID 
Lists,  suggesting  that  intelligibility 
scores  obtained  with  the  R-CID  Lists 
would  be  less  inflated  by  message  pre¬ 
diction  (Giolas,  et  al.5). 
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